Searching PAJ 



1/2 s<— v 



f 



J 



PATENT ABSTRACTS OF JAPAN 

(1 1 publication number : 06-1 38373 

(43)Date of publication of application : 20.05.1994 



(51)Int.CI. 




G02B 7/28 






A61B 3/113 








G03B 13/02 




(21 Application number 


: 04-291728 


(71)Applicant 


m m -r* ► ■■ . ■■■ ..... - « .-r ■ * »»» - 

: CANON INC 


(22)Date of filing : 

r. r " .... ■—;■-»■—■ - — - 


29.10.1992 


(72)Inventor : 


AKASHI AKIRA 



(54) SIGHT LINE DETECTING DEVICE 

(57)Abstract: 

PURPOSE: To effectively eliminate a false pupil edge, 
and to improve accuracy for detecting the line of sight 
by estimating a pupil circle by using the least square 
method based on extracted all pupil edge data. 
CONSTITUTION: Extracted plural pupil edges are divided 
into the upper side part 71, the lower side part 72, the 
right side part 73 and the left side part 74 of a pupil 
circle, and based on data of the remaining sides except 
edge data of one side, a pupil circle 75* is estimated, and 
simultaneously, an estimated deviation quantity is also 
calculated. That is, for instance, in the case an edge of 
the lower side of the pupil circle is extracted 
erroneously due to influence of an eyelid, when the pupil 
circle is calculated by using extracted all edge data, an 
erroneous pupil circle 75 is obtained. Therefore, by 
estimating the circle by the data from which the lower 
side edge in an enclosure 72 is eliminated, a correct 
pupil circle 75' can be detected. In this case, since the 
circle is estimated by using the minimum square method, 
the radius or the diameter of the circle is used for the correction. 
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[oo8 3] m&^tDmmmfrbpmfamtmiifewz: 

(#2 0 8) 0 

[0 0 8 4] m5lC!i?L*4X lS?L^^tH^^^~^ 

x c = (W 1 • V 2 - W 2 • W4 - 
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# 3 0 0£— T# 301 ICT, tttb^ttfc^T<7)Bt?L^ 

12109 m-) ic^^-cv^^, zzicftirmML 

X&< 0 

[0 0 8 5] nm(Om^^v^(nm.m$:&* (xi , y 
1 ) , (x2 , y2 ) , — , (xn, yn ) t-fZb, 

*70 .bmm (xc, yc) . 3Mlrc, M^tSMgERte 
(W6-Y1-Z1) -W3)/2- (X2 



•V2-W5-W6 - Xl/n) (10) 
y c = (W2 • V 1 -W 1 - W4— (W7-X1-Z1) • W3) /2 • (Y2 



• V 1 - W5-W7 • Y 1/n) —(11) 
r (W3-2 • ( (xc - Xl+yc • Yl) / n) + x c 2 + y c 2 ) 

- (1 2) 

ERX = X4-4«xc - X3 + 2 (2 • x c 2 + d) • X2 

— 4 • xc • d -X1+Y4 — 4*yc • Y 3 

+ 2 (2 • y c 2 +d) • Y2-4 • y c • d 

+ 2 (Z4-2-xc-Z3-2-yc-Z2 

+ 4*xc-yc*Zl) +d 2 • n 
ER=7" (ERX/n) 



Y 1 



(1 3) 
(14) 



X 1 =2 x i , X2 = 2 x 



X3 = Sx i 3 



Yl=2y i, Y2 = 2y i 2 , Y3 = Z y i 



Z l=Zx i • y i 
Z 3 = 2 x i * y i 



Z 2 = 2 x i 2 
, Z 4 = x i 2 



y i 2 

y i 2 



X 4 = 2 x i 4 

— (15) 
Y 4 = 2 y i 4 

— (19) 

- (2 3) , 

- (2 5) , 



X 1 • Y 1/n) 



V 1 =X 2-X l 2 /n 
V2=Y2-Y1 2 /n 
Wl =X3+Y3 
W2=Y3+Z3 
W3= (X2+Y2) /n 
W4=Z 1 -X 1 • Y 1/n 
W5= (Zl-2 • 
W6 =X 1 • Y 2 
W7 =X 2 • Y 1 
d = x c 2 + y c 2 — rc 2 

K±^*<fitH*£tT*:tf, (xc, yc) % ¥ 

c irft/h2**t^^SER^^i65r kfcXZ 

[0 0 8 6] rw-C«3g^S6fiER-C*>6d«, ft^Uifi 

ztix&i^cDtztK r c [-£6 



(1 8) 

(2 2) 
2 4 
2 6 

2 7 
2 8 

2 9 

3 0 
3 1 
3 2 
3 3 
3 4 
3 5 
3 6 

[0 0 8 7] ^n^r^^-T^/c^^^^J: p(-gidFL^ 
r c Srfflt^TKSia:ERt:ffljELrv^S 0 
[0 0 8 8] 



Z 1 
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ER = ER • (a • r c + b) 
rr-C\ #J;if3a 12- 0. 05, btel. 5m&<nB& 

(DtZffilE&ma • r c + b \**> X 0 H 1 t ft 9 , ER 

*\ £fctettft;^l^c9 LTBS?L^r c 

9, 0*Jx.l;fr c = 2 0lC&5£:, filE^ a - r c + b 

ffiTrl*, ®7LSr c^3 0Hi^^^5<hffljE^^a • r 
c + bttO t^oTli 5 d 5 . r c&2 0\mm£l±<Dt 

[0 0 8 9] HI 7 (a) tcR<Dl:/h2^^y/W~^ 

[0 0 9 0] m^r/jv— ju£tiZ>t. Xry 

^#4oo^gt#4oiict, 2 m&<Dmn&<p 

ftXl-X4, Y1-Y4, Z1-Z4H«^ (1 

5) - (18) , 5£ (19-22) , 3£ (23) - (2 

6) (:toTlWt^ 0 &K«£ROff3|£:m> (#4 2( 
0 2) . U^ — >-T5 (#40 3) 0 

[0 0 9 1] 17 (b) temmF)<Dfrm<7>V-7 p /l>-^> 

in±^Iitavi-W7^ (2 7) ~~ (3 
5) ic^oTffSL. ^ic-^rix^^^^^^T^R 
^MIxc, ycSrftif^ (10) , (11) 

c, y c OfitfcJB^T^ (12) t^oTtf-SnT^o 
[0 0 9 2] S (36) t (13) , (14) 

^oti^iiER^^if) (#5 0 2) x 31 
(3 7) M££o-£\ lifter c ^<fc 5 ^SER<7)fflIE 

£?T? (#5 0 3) 0 

[0 0 9 3] ^ C7)i Mat, It^RO^k (xc, y 
c) , *8r c, *t^Kil*ER*s**9, I^A—^ 
V^y (#504), . 

[0 0 9 4] £1±<D± x-r ^y^# 3 0l(:fc 

X 1 <-X i-xr 

X 2<-X 2 -X 2 ' 
X 3<-X 3 -X 3 * 
X4<-X4-X4' 

^isx i— X4tts: (is) — (is) a»e>9ie>a»ftj: 
5«-lfcffl*aws;"C*5^e>, ±03; (3 8) ~ (4 

1) ^rtf^-rst, ^(Dtg&x 1-X4lt Tifl^s^ 
£|*^fciy^fcJ:3£Ri*5. ^TX1-X4^- 

[0104] j^MYl-Y4, Z 1— Z 4 t>^iC 

ffliE-r^ (#602) o z<D&\zmmn<D9tnt:ftjL& 

(# 6 0 3) , 't(^)^m^Ti2^y^S:{^V^y5:^^/^^c 50 



#H^6 - 1 3 8 3 7 3 
(3 7) 

*C0if5t£rtToT\ KtqpLRiO^i^ffifil (x c, yc) , ^ 
*£rc, I^itER^^xb, wCDER^Ufi 
HfflERTHRtittSE-rS (# 3 0 2) 0 

[0095] miiwnmmfcftfttemmvn'iTZtizb 

#<&*3t»S*ERttffi#l 0^TTr£>5<7)T\ H4£E 
RTHRIJWitfl 5-2 0iSl:KUfc<o 
[0 0 9 6] ER<ERTHR, BP^itS^H^/Jx^ 

KTLottatt^L^fc^tast IT (# 
3 0 3) , ^t^V^y^y^-yfs (#3 0 

4) o 

[00 9 7] ER^ERTHR, EP*>*t3^H#;*:#^ 
[0 0 9 8] *f7ry^# 3 0 5TU ttffi^nfcIS 

[0 0 9 9] I^^(C^-t l -/^ p # 3 0 6 Tfttiffla; y S**r 
^§£\ ^fy^ 3 0 8T'^iZ3^^/^^|^V^/c^(7) 

[0 10 0] B8 (a) H:Tia^y^£»^fcR<D*/h 
2 * jg £ <7) hj- y / v — ^ v <D 37 p — T- &> 5 o 

[0101] 3fe"T^7 i y^# 601 [ZXs e?LRc7>TiZ2 

(1 5) - (1 8) , (1 9)-(2 2), (23) - 
(26) iCftoTXr -X4' , Yl' -Y4' , Z 

[0 10 2] ft^ttT^y^— ^-ctmESnfe^^ 

^tx 1 -x 4 $r^^;co<t 0 tcMiE-r^o 

[0 10 3] 

— (3 8) 

— (3 9) 

— (4 0) 

— (4 1) 

[0 10 5] ±5S3iy^S:l»V^tt7LRO|t^ &i22^ 
y^Srl»^^Ri7LR<o*^ *ria^i v ^^tzMlLn 

[0 10 6] H5ldJRoT, Tifl, Jbi2, *52, ^i22CO 
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[oio7] w&t£hmmi^yv<nte&famte*^ 

[0 10 8] MWiCd ^ry/# 3 0 5, 30 ex- 
it h ixtzm^m^m e r £ mm x k> t * z < * 5 <t 5 1- 

[0 10 9] wr-CfiTia^y^SrBfeV^feS^ftfcft 
[0 110] ft^ry/# 3 1 0"CttR<fcflM>2*J£ 
[0 111] ttftSra^**, SfcKSWSftfcR*!** 

X 1<-X 1 + x k 
X2<-X2 + xk 2 
X3<-X3 + xk 3 
X4<-X4 + x k 4 
^»Y1-Y4, Z 1-Z 4lCOV^Ttl^«{^fH|[i--5 
(#8 0 1) , ^i-^tCft/h2*^0^07 f -^^l 

[0 116] IT, ffijE£frtz&^%t*mi<^XnXf 

(ER/ERo ) <C a 

ft f£ , iifln U fc^ y i?i*M<0^ y i? t H^-To C a 
[0 117] ifj[ni*d5*#V^#{ctt, ^P^L^y^tt 
Y1-Y4, Z 1~Z 4 kMl£F]<Df&m&^<D7*--?%: 
[0 118] l^<D^yit\Ctt\^X<DU,fttimt>Z>k?k 

i»T^ov^r<^KtTdSj|*Ti"5t (#8 0 5) % -mz. 

m^fhX^^tzTm=^yV'y £ —^<D o *>iEUV^^ 

y *->-r3 (#8 0 6) 0 

[0 119] J£X±f*. Tifl3iy^*»*tt5ff»|-)H 

[0 12 0] Ra)*/h2*«l3£^l¥«-»l JctoTiEb 

OJt^gl^g: E R <t gg££MffiE R T H R £rSint«tfc L 

(#3 11) % ER<ERTHR*fctftt^ftttitt/85b 
Lfc£L (# 3 0 3) , i^-y/U— ^>-^y *->TZ> 
(# 3 04) 0 

[0121] ^43t*fi®s^fl:ds*frv>»*^tt, ^m. 

X 1 <-X 1 - x k 



L V >gfi?L^ 2/ i^-Cfe 5 t <D £ JLft L T * co * * tin ^T*5 

■ [ou2]B8 (bi \zw<om*2mmmw&&i<D 

[0113] v^T3a^s/^5»^n-cv^*£3B*ds 

"r y^fn 8 0 o^&n-rz> 0 
[01 14] »^fy^# 8 0 iter, Tia^^^» 

OH^lo^ (xSS, ylg) Sr (xk, y 
k) 1 1 S i ft^lC J; o t §/Jn 2 1 X 1 - X 

4 0fBlE£:fT5 0 
[0 115] 

— (4 2) 

— (43) 
... (44) 

— (4 5) 

^Ji^Rc7)H-J|£;tf 9 (# 8 0 2) 0 Srfcfci£30» 
iiERi:, 1 oiij[jp-^^mj(7)^^aERo <Z) 

— (4 6) 

[0 12 2] V^Tia^y^trttV^ BP^ (±i22 x & 

30 ^^-/>^# 3 12, ^^^^# 3 1 SZmXXTy 

^#3 1 6«cr±ia^y^BB-rSROfl:/h2**6«f? 

[0123] m 9 \zTm^m-r ^>F]<om^2 mm^w 

fYW2 A(D7v—?^r— b&Tjk-fo I2-^2A, 2B, 2 
C, 2Dte^^*UiTiZ2, _hi2, *i22, &i2(-^L 

[0124] r ^xnn%f^2 A<DTm\^m-t^>^^ 

So 

[0 12 5] m^-y^— ^>^?=i— /u£ft<5<fc, 

o$rf^< J:9i:^»xi-X4, Y1-Y4, zi 
-Z4 4rMiEi-5 (#9 0 1) o V&Zo kTZ>x.yiS(D 
J^SSr (xk, yk) £-T6<!:, X l — X 4 Ji^co J: 

[0 12 6] 

••• (4 7) 
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X 2<-X 2 - x k 2 
X 3<-X 3 - x k 3 
X 4<-X 4 - x k 4 
Y1-Y4, Z l-Z4lCO^-C{)^it*fe5o 
[0 12 7] ^ + ^m^>MlE^^^^, ftO^^y^S 

[0128] ^^iiiico^; (4 6) \cxm^m^m(D^ 
itmznw-L (#9 03) , tcom^m^m^x i>± 

U ^T5'7 P # 9 0 4T^aXl-X4, Yl-Y 

4, Z l 4 43<J:t/^Ro^m^7ctcM-r o 

[0 12 9] ^If^KD^^fl]^^, Um-fZUXCD 

^v^-ficn^z&fttmj-rzk (#905) , 

$f/;u-fy^y^-yf5 (#9 0 6) 0 

[0 13 0] H5lCRot, # 3 1 6X<D±m^yi/{C 
SER^^^fiERTHRJtgeL (#3 17) , mm 

(#303) . zcD-y-y/io-^^zv ?-i/-rz> (#3 

04) 0 

[0131] *tm7£mmm&±%\<^Wr&\a^ #h£t 

1 LXme<Dya— ^Wfs U ;&iZ2, fciSKHHL 

3 0 3ldr»7L^tH^i:LT x i^^/u-^ v£r y ? — 
>"fZ> (# 3 0 4) o 

[0132] ^±<D^m^mnLxhs ^tcmmmmm 

ER&±$\,^m&m&KWiltt&!kf&kL (# 3 2 4) . 
i^^/u— ^V^y (# 3 2 5) 0 

[0 13 3] 0 1 3£JB^T. 

(IHl 3 (a) ) (DmXit. 3i&ti(D&mX+ 

1 3 (b) <£>7 5(^$D< > ISo^MR^/iott^ 

[0134] *zx\ ^mxco^izvtox. 013 

(c) OJ: 9^CHV^7 2^c0Ti22^-y ^^^tJ^V^/c^ 
— ^T-R^m^LT^fttf, 75' <D£ 5iCiELl^i?L 

[0 13 5] 0 1 3fi^^/c{Cj:5S^^^JT*feo/c 
Eli 4T'li^o^ia5CT^t5o 

[01361014 (a) <D5 3(i^O^^^UT*5 
•9, r(Dfei60lTLTi22<i: LXtethZtitz^ y istp^m*) 
<DMH^yi?tf'$'£tiX\<^Z> 0 

[0137] mm (b) <D7 5i*mitiLit=*yi?&±n 
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••• (4 8) 
••• (4 9) 
- (5 0) 

[0 13 8] wJh,**38WTW#M&KtfcoT, 130 
(c) <7>J:9tCT^^'>> ? t>IEUV>3i^>? (fflv>7 2 

b) kfa*)<D^yi? (I^7 2a) \z.mWh\cftmirtrh 
70 75' Sr**Swt}ast?#5. 

[0139] fttonmmxi*. muM&m^xmmmm 

S^rttjE-f 5 BR. — ftstSrJBi^fcas, rn ft- Schleps 
[0 140] *Sa6fi»J-Ctt*/h2*fe«rffl^-rR 

20 I 0 1 4 1 ] 

x. % ^cO^^v?M^^^V^T^7LRC0^W^fT9^, 

[0®<OfBS^Bi^] 

[111] *IBW4r#a!itcjllfii-5r 7^) 
^g&*K»£0o 
30 [12] Hi O*;* 7<Dm^[HlS§0o 

[03] H2 0lj!jf^^-t-^n— ^ — h 0 

[0 4] a«ftffl»^7o-f + -h 0 

[0 5] 0 4^Bt7L4 3 'L^ ltTL^O^m<7)^D-^Y — 

ho 

[16] |5^Ti »7u-f-t^K 

[07] 0 5<DROft/h2SMeS»f^<Z>7P-^-> — 

he 

[0 8] (a) nTm^yV*m^tcF]<Dm^2mm 

^> (b) f±R<Dft/jN2*«£f5W-3(Ll W7D-ft- 
[0 9] R Of /Jn 2 f itSitl 2A07n-ft- 

K 

[0io] mm&<Dim®t<Dmo 

[0ii] «»S*m*ifc<z>W«!ft910o 

[0 12] ii»OlKTLR«fflOORW0 o 

[013] *-^^0^»SrSJtfcS-&^>Bl?LR^ttJOift 

[0 14] *o^o«*S:S»t/i:»'&<7>lttfl 4 R«fflOlft 
W0. 
50 [«F*rottW] 
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